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(54) Click and select user interface for document scanning 

(57) A user interface for scanner software that 
allows a variable resolution preview scan (204) of a doc- 
unnent to be presented (300. 302) to the user in a pre- 
view box (202) within a scanner software window (200). 
The user clicks (306) on a point within the preview scan, 
and the classification of the image innmediately around 
the click point is determined (400, 402). A selection 
marker is automatically drawn (500) around the 
selected image, and all portions of the preview scan 
outside the selection marker are grayed out. Based on 
the classification, adjustments are made automatically, 
and windows having control tools for adjusting various 
aspects of the selected image are automatically ena- 
bled or disabled (506 through 528). Once the desired 
area is properly selected and any adjustments have 
been made, the user can drag and drop the selected 
image with a mouse onto the desktop, a folder, or an 
open application to launch an optimized final scan of the 
selected image. 
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Description 
TECHNICAL FIELD 



[0001] This invention relates to document scanners- '5: 
and more particularly to the user interface for document - 
scanners. Even more particularly, the invention relates * 
to a user interface that allows a user to automatically 
select a region of interest from a preview scan of a doc- 
ument. '10, 

BACKGROUND OF THE INVENTION 

[0002] Current scanner technology allows a user to i. 
capture and utilize all or portions of various scanned is 
documents, images, objects, etc. for use within various- . 
computer applications, even when the documents are 
comprised of a variety of different components. A docu- 
ment containing text, black and white and/or color pho- 
tographs, graphics, and color and black and white line. -20 . 
art can be scanned in its entirety Alternatively the user • - 
may choose to select "only certain portions of the origi- • 
nal document for scanning by utilizing scanner software 
to select an area or particular image contained in a pre- . - - 
view scan of the document. The selected area is then, 25 
scanned to produce a final image-. 

[0003] The usability of existing scanners and their • 
associated user interface for selecting portions'of docu- . 
ments has been hindered by the inability of many users . • 
to understand the simple concept of drawing a selection 30 
box around the image of interest in a preview scan of 
the docunient displayed in a window in a computer mon- 
itor indicating what wit! be scanned, for 3 -finaL image. . 
The result is that, in many situations, the-user scans thei: - ^ 
entire' document when -only a. portion was actually- 35 
needed. Typically, the user will then visually crop the . ; 
image of intierest from the entire scannedidocuhnent in 
an application; such as a word processor or an Adobe, '.^ y 
PhotoShop^" editing type application. Thus, valuable file; > : 
space, as well as precious- time. 'are waste4 40.\ 
[0004] Existing solutions tend to stress automaticity at • : 
the expense of user flexibility, or else, simplicity at the.. . 
expense- of accurate region finding and definition. The. 
former is exemplified by scanners in which default 
regions are iDrovided^ by an autonnated page analysis. - 45c 
technology that "can annoy users^interested in selecting ; 
only certain portions -of a scanned document. The latter : 
is exemplified by' sca'nhers -in- which^ relatively simple - 
pages cannot be readily subdivided- into appropriate 
regions of different types (e.g., text, drawings, and 50. 
'images). The present invention allows the user an inter- " 
mediate solution, in which the automaticity -.of region r ' 
selection is controlled by the use?s clicking of a mouse ■ . 
within the region they wish to-be automaticaijy selected. 
The user then has the ability ta readily override the first 55 
estimate of the bounding box. if it-proVes to be incorrect, 
by using the user interface. " 

[0005] It is thus apparent that.there is a need in the art ^ 



for an improved method or apparatus which solves the 
objects of the invention. The present invention meets 
• these and other needs in the art. - - ; v - : 

- OISCLOSURE.OF THE^INVENTION 

-[0006] . It ls:an aspect of the present.inventloa to click 
with a mouse on a point within a region -or image of 
interest irua preview-scan of a, document |o 'automati- 
cally, select the regwn or iqiage of interest for.^ an opti- 
,',mized re-scan of the region or image of interest. 
[0007]-. . It is another aspect of , the invention to initiate 
with scaoner -software a variable resolution cpreview 
sc^n of. the document, and present the preview scan 
data of the document in^a variable resolution preview 
window of. a computer monitor. 

[0008] Yet another aspect of the invention is to display 
a selection nnarker around the selected region or image 
•of interest in .the variable resolution preview window in 
the cornputer monitor.- . „ 

[0009] Still another aspect of. the invention- is to evalu- 
ate the region or image of interest and classify it by type, 
such as text, grayscale image, color image, or black and 
white ;image. 

- [0010] .. A further aspect of the invention is to gray out 
those areas outside of the region or image of interest 

..bounded by a selection marker. 

'[0011] A stilt further aspect of the invention is to ena- 
.ble or disable windows having tools for adjusting various 
aspects of the selected region or image of interest 
bounded by a selection marker prior to initiating a re- 
scan of the selected region or image of interest. 

' [001-2] . : Another aspect of the invention is to resize the 

i-initial^region or image.of interest selected by simultane- 

: ously clicking on a point and holding down a control key 
on-a keyboard to either expand the region or image of 
interest to include additional area, or contract the region 

' or image of interest to exclude area already selected. 
.[0013] .A still furtheraspectof the invention is to resize 

-,tKe initial ceg^ipn or image of interest selected _ by right 

••clicking on , the ■ misuse to open a context: nrienu. and 
select an expand selection option or select a contract 
.selection: option frpnn the menu. T - . 

:j{0014] ' Yet- still another aspect of the invention is to 
des.eiect a region or image of interest bounded by a 

i :Selection marker by clicking Mn -an appropriate area of 
white^paice within the preview scan. 

: [00.15] V The- above and.other aspects, of the invention 
-are; .accomplished in a user interface for scanner soft- 
ware that allows a variable resolution preview scan of a 
document to be presented, to the user in a variable res- 
olution-preview window of. a-cpmputer monitor. The user 

; may then click on a point within a region of interest in the 
variable resolution preview scan data in the variable res- 
olution preview window. Based on the characteristics of 
the data represented at^he click point, an area js deter- 
mined that encompasses the click point and the neigh- 

' boring points that have similar; eharacteristics{.to that of 
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the-clfck'point: This area is then classified by type based 
on the characteristics of the data represented within the 
area, such as text, grayscale image, color image, or 
black and white image.'A selecfion inarker-is then auto-^ . . 
matically displayed around the area as a first estimate of 5- 
what the user^intended by making the mouse click at the 
click point/ ■ i ■ - 

[0016] The selection marker may be a bounding box 
rectangular in ^ shape. For nofn-rectangular "lasso" 
regions^ image analysts -software may be applied, auto- 10 
matically tracing around the 'lasso region of interest. 
Portions of th*e scanned document that lie outside the 
selection "marker are grayed out. Based on the determi- 
nation of the type of area/adjustments~are made auto- 
matically to data type, exposure, color, resolution, and * 'T5 
sharpness settings that normally would* t>a^e to be:~ : ^ 
made manually by-the-user in prior art systems.- • - t 

[0017] If the selection marker automatically generated 
does not represent the image of interest desired by the '■ 
user, the user can adjust the size of the region of inter- 20 
est to ihclude rhore area or include less area in several 
different ways. One such way- is by dragging the selec- 

^tion area handles appropriately expanding dr'contract- 
ing the selected- area. Or; the^aser may sirriultaheously 
ciick on a point and hold down a. control key on a key- 25 
board, or right click' on the mouse, to either expand the - 
region or image of interest to include additional ^rea. or 
contract the region or image of Interest to excluide area 
already selected: The user may also right click on the 

' mouse to pop up a context menu, and select an expand 30. 
selection option or select a contract selection option 
from the menu. In addition, a different region of interest . * 
can be selected by the user by clicking in an unselected? 
area of the variable 'resolution preview scan, and drag-/"" 
ging the hiouse to create a rectangular ared bounded by "35 
a selection marker ..r=L ---r 
[0018] Based oh the type^of image; windows having ■ : ' . 
tools for adjusting various aspects of the sefect^d area-j i. - 
are autbrnatrcafly enat>led or disabled from us"er input. 
Once the region of interest is propeil y 'Select e'd/and any 40 
adjustments ha^e" been made.^the^ user>vean use a - ^ 
mouse to drag and drop^ (h^e selected areaivonto ther ' 
desktop, a'writeable folder or bnto^an op^n 'application' I '-.i- 
to launch an^ optimized final scan, or re^sasan; ot^the v ' 

■ selected area. After the<>ptimi26d fin^l scan.-^the result-' 45 
ing image d^ta resides in thl^ desktop, fofctef. in a file, or . 
within the open application. -Alternatively JlifeCOser may-s ■ 

' utilize pull down miehufe or buttons 'to' lafimcfe'the opti- : ■ 
-mized final soan: However, if the-^ bull '-dbwr^' menu is ^ 
used, save to file, copy tcr' clipboard.' antt'print are the- 50 
only options available; Thus, the resultrng. image data-, i _ 
will not automatically- appear in an openrappJication if. 

-this option is utilizisd. ' ' ' : . c ce: = •^ar^r^r 

'DESCRIPTION OF TH&DRAWIhiGSt z;/ ■ : ^5 

:[0019] ">The above and otheir aspects, features, and 
advantages of the invention will be better understood by 



reading the following more particular description of the 
invention, presented in conjunction with the following 
drawings, wherein: 

" FIG. 1 shows a block diagram of a computer system 
incorporating the user interface .for scanner soft- 
ware of the present invention; • 
FIG. 2 shows, a representation of the screen display 
of a computer monitor showing the user interface 
for scanner software of the present invention; 
FIG. 3A and Fig. '3B show a block diagram of the 
overall flow of the operation of the user interface for 
- scanner software of the present invention; 

FIG. 4 shows a block diagram for determining the 
boundary;, of the region of interest and classifying 
r the/type of data within the region of interest; 

.F4G.. 5 shows a block diagram for updating the 
screen display of a computer monitor based-on the 
selected area' and. its type; *. 
FIG. 6 -shows a block diagram for. performing an 
optimized final scan of the selected region utilizing 
the drag and drop feature from the Windows oper- 
ating system; and 

f\G. 7 shows a- block diagram for re-sizing the 
boundary of a region of interest. 

BEST MODE FOR CARRYING OUT THE INVENTION 

[0020]- . The following description is of the best pres- 
^ently contemplated mode of carrytng:^out the present 
i^nvention. This. description is not to be taken in a limiting 
sense, but is made merely for the pujpose of describing 
the general principles of the inventiofi,vj:he scope of the 
invention should be determined ,by^Feferencing the 
appended daims. , * • . 

[0021]' -FIG. 1 shows a blOiCk diagram of a computer 

• system incorporating the user interface for scanner soft- 
. ware of the pr^&ent ipvefition. One skilled in-the. art will 

recognize th^t- many other configurations are possible 
, for accesstRg^a.scaf^ner.yyith. a co(nputer system. Only 
one configuration isishowO' for simplicity. Referring now 
■ to.;FlG. 1, connputer system IQp contains. a processing 
. element '102: Proe^^ssing element 102 communicates 
with^other^el^enls of computer system, 100 over a sys- 
tem bus=^ 04?.! A ..key board ,106 allows a user to input 
i information : intQ/tCornputer system 100 and a monitor 
11Q'.altows computer systerTi, 100 to output information 
. to .the. user A-.gfaphicah:i|iput device ;108, commonly a 

• mouse, isv also -used., to ^ input .information. Scanner 
. device .1-1At§, also usejd-tp input information to computer 

systeTOciOQ^;: r - . >. ■■ 
. [^)022]:->-Sloriagejdevipe-112,js used to-store data and 
- iprogeamg * within -computer system 100. Communica- 

• tioosMnterfage 116, also connected to system bus 104. 
receives: infomnation from, sources outside of computer 
system 100. A memory 118, , also attached to system 

• bus. 104. contains an operating system 120, window 
manager 122, and scanner software 124 having the 
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user interface for scanner software of the present inven- 
tion. In the^Dreferred embodiment of the invention, oper- 
ating system 120 is the Microsoft Windows ® operating 
system. Memory 118 also contains first software appli- 
cation 126 and second software application 128. One 
skilled in the art will recognize that many more software 
applications could reside in memory 118. Only two are 
shown for simplicity. \. ' . . 

[0023] FIG. 2 shows a representation of the screen 
display from monitor 110- (FIG. 1) showing the user 
interface for scanner' software 124"{FiG. IT of the 
present invention. Referring now to FIG. 2. scanner soft- 
ware window 200 shows a variable resolution preview 
window 202 containing variable resolution' preview scan 
204 of a document that has been positioned'oh the flat- 
bed of scanner device 114 (FIG. 1). A user initiates a 
variable resolution preview scan 204 by pressing a pre- 
view scan mode button on scanner device^114*{FiG. 1), 
or through a scan button or pull down mehus presented 
to the user on monitor 110 through scanner software 
12^, which sends a signal causing scanner device 114 
to use a preview scan mode to scan the document. A 
preview scan mode is typically a low resolution scan, 
dependent on the resolution of the- display and the size 
of the preview window. A user may also initiate a zoom 
scan of an area of the document 'posiitioned on the flat- 
bed, in which case the resolution of the data contained 
in variable resolution preview window 202 may be that 
of the scanner, which could be a considerabty higher 
resolution than the preview scan mode. The data gener- 
ated from the variable resolution preview scan is dis- 
played as variable resolution preview scan- 204 in 
varicible resolution" preview window 2G2. Variable reso- 
lution preview scan 204 shows regions of various types, 
including text regions 206,' black- and white tine art 
regions 208.- color jDhotograph "regions 210, and gray 
scale photograph region 212. which is partially superim- 
posed on-one of 'the color photograph regions 21 0. 
[0024] A user has moved pointer 214 within gray scale 
photograph region 212 with-gra'phical input-device 108 
(FIG. 1) and has subsequently- clicked on -graphical 
Input device 108. Scanner software 124Teceives the 
click input, with pointer '214 fhlhe shown location, and 
determines a boundary for the region* surrounding the 
click point, and what "data- type of 'region is within the 
boundary. Alternatively, -a us'er'cah 'Accomplish "the 
above manually by moving pointer 214 to a "corner of 
gray scale photograph region 212} and then^clickihg and 
/dragging graphical input device 108 to'enconrrpass gray 
scale' photograph region "212 and then manuaUy setting 
the data type via a pull down m^hu. In eithercase, vari- 
able-resolution preview window " 202 1s updated with 
selection marker"216'drawn a?ound'the' region identified 
as gray- scale photograph region 212. In this ekkmple, 
selection marker 216 is a rectangular bourndihg box. 
The rest of the area'of variable resolution pi-eview scan 
204 outside of gray scale photograph region -212 is 
grayed' out {not shown in FIG. 2). * • ' 
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[0025] Variable resolution preview window 202 also 

• contains -pull down menu bar -218 :and:tpol:t>ar 220. 
- . which^provide the user with access to yarious functions 

. i-of scarifier software, 124. Hf no region has.been. selected. 
.5," status t>ar 222 displays information regarding j^/ariable 
resolution preview scan 204 in its .entirety If a region 
has been selected, as shown- in FIG. 2\ status bar 222 

• displays current information regarding: -.the *, region 
. ' selected.- which in this example is : gray scale photo- 
iO'~ graph region 212. Box 224 indicates --that the. region 

selected is a gray scale photographic image. Box 226 
-indicates the image file size is 51:7. KB. A scaling factor 

- of 100% is shown in box 228. A different scaling factor 
. may be displayed if , an inter-application. communication 

15, link, such as TWAIN or OLE, has been established indi- 
eating- a preferred final size of the region of interest, or if 

- the user has specified one. Box 230.'indicates that the 
. ~; -se^ected -image is measured in inches. The user may 

.- also make a "units" preference for. Box 230 other than 
20' inches, such as centimeters, points, or pixels. Box 232 
indicates that the selected image is 1.38 inches high. 
. and box -234 indicates, that the selectedJmage is 1.74 

- - . . inches wide. Box 236 .indicates a current resolution of 

- -150 dpi.. - . - , ■ - M 

25 [0026] Three floating windows are also shown in scan- 
ner software window 200 that present control tools to 
ithe user The controls reflect adjustments made to vari- 

■ able resolution preview scan 204 based on the contents 
•of the preview window.cThe user may use the tools pre- 

30 sented in the floating windows to further manipulate a 
selected region ofHnterest. .. \ 

' [0027] * Exposure adjustment window 238 offers con- 
'• ■ trol tools that apply to all photographic output data types 
. • ^. to preserve highlight and shadow detaik Color adjust- 
35 ment window' 240 "applies .only to color photographic 

• - ^ output data types to adjust hue and saturation. Black 

• ' and^^white threshold window 242'applies only to black 

- "and white binary output data types such as line art. clip 
• 'art- halftones, and text. - . - 

^^o >-[0028] FLG.^SA and FIG. 3B show a block- diagram of 

- the bvera Inflow of the operation of the user interface for 
scanner software of the -present invention. The user 

■ v'. -interface is called from scanner software 124 (FIG. 1), 

i' when Requested by the user of the scanner software 
43 ^- ^124:' Scanner software. 124* performs other scanner 
" ifu net ion's which are not part of. the invention. . " 
V " :[0029] V Refen-ing now to ^FIC'tSA and. FIG. 3B, after 
entry, in step' 300 a variable resolution preview .scan is 
\ ' 'Initiated' for a document* placed in -the fiatbed' of scanner 
' 50 14 '(FIG. 1) that may contain text, line art.' and/or color 

- ^ahd-"black and white photographicimages of interest. In 

* step 302, variable resolution preview scan '204 (FIG. 2) 

- - is -displayed within variable resolution "preview window 

- - '202--(FIGP2) in monitor 110 (FIG.. 1). - ^ ■ 

55 ' .'[0030] '-Step 304 deternhinesrf click input from graphi- 
'=^*cal input device 108 (FIG. 1) on a region of interest 

- " withinVa'riable resolution preview scan 204 is received, 

-' or if a manual selection is made -by clicking in an unse- 
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'lect^d'are'ar and-dragging the mouse to create' aTectan- 
."^ijilar selection area, or if an indication toi.quit the user : 

. interface.-is received. If the latter is truef FIGv .3 returns \ 
to scanner software*124. If a nnanual selection is.nnade, 

-then ln:st^p-305 the-click'and drag Input establishing a 5 

!r- bound a ry^-'a round a region of interest is received^ Then 

- in- step* 307 scanner software 124 performs classifica- 
tion anaiysis--on the set of . data elements contained - 
within- the boundary established by step 305; as more 
fully explained in'.RIG.*4. - : . • ? io 

' [0031] -If clifck input Is received in step 304, then in step : 
306 click input on a region of inte'rest is received by 

' scanner software 124. Step 308 calls FIG. 4'Whlch eval- 

' uates the region surrounding the click point to deter- - 
-mine Its boundary and its inriage type. After returning is. 

' from FIG. 4. step 310 then calls FIG. S to^up'date the 
•screen display of monitor-1 10. After returning from FIG. 

''S; step 312 'determines If further Input, or an indication :.; 

' to qult^the user Interface, is received. If the latter is true. 
FIG. 3 returns to scanner software 124. If the former Is 20 
true, "then step''314 determines what type of -further 
input was received. If thelnput received was a "mouse 
down" input signal selecting the region of interest for a * * 
potential drag and; drop from graphical input device 108, - 
then step 316 calls FIG.'e to' potentialty perform^n opti- 25 
mized final scan of the region of interest. After returning 
from FIG. 6. control returns to step- 304' wher:e;.another , 
region of interest may-be selected, or input received to 
q.uit- the user Interface. . " , v* 

[0032] If the Input determined in step 314 was click 30 
input from graphical input device. 108 :on while;'Space 
within variable resolution previewiscan 204. then in step ; 

. 318 scanner software 1-24 removes selection ^marker 
2t6 that was placed around the. region of .interest. This - : 
action de-selects ihe current image selected. AH por- ^5* 
tions of variable resolution, preview scan 204;, that had -i -, 
been grayed out are restored and the display inyariable 
resolution preview window 202 (F^G, 2) in monltQf 110 is : 
updated. Control then . returns- .^O; step 304r'>v here 
another .region of interest may cbe -Selected. - .or input ifo- 
--received to . quit the user interface». ^ -r i : - 

[0033] Finally If the inpu^deteTmined in: 3tepr 31:4 was ' ^ 
click input on a region simultaoepu^ withva cpntfol key 
held down, then step 320 cafls. FIG. 7. Jte re.-size the ; 
boundary of . the- region of interest. -After returniog from 45 
FIG. 7: control returns to step 310. whi(5h is a' s^llto FIG. 
5 to update the screencdisplay of monitor r1 1 Qni^.t- 

* [0034] : *FIG.-4 shows, a. block diagram farudgtefmining . 
the boundary of the region of interest an declassifying the . 

. type of data within :the region of interests Refe/ririg now . 50, 
to. FIG. 4, after entry, scanner softwareN 124 performs an - .. 
analysis on the data elements from vctnaiple ce^plution 
preview scan 204 on the immediate regjpn; arqurnd the « 
point clicked to determinei ih^ bqundary of the region of - 
interest and the data type^within the regjo a. pf interest. In 55 

^ step 400, segmentaiiofi analysis is perfoirmed to deter- 

, -mine the bouadacyiOf the. region of interest. Various 
techniques are well known in the art for performing seg- 



mentation analysis, falling Into thre^e broad categories: 
■top down strategy (model-driven), bottom up strategy 
(data-driven), and hybrid. For example, see Theo Pav- 
lidis and: Jia.ngying Zhou. Page Segmentation and 
Classification,- publisheci in Document Image Analysis. 
. pp 226-238, (Lawrence O'Gorman and Rangachar Kas- 
turi, IEEE Press. 1995). Also, see Anil K. Jain and Bin 
Yu. Documentation Representation and Its Application 
to Page Decomposition, published in Pattern Analysis 
and Machine jntelligence. pp 294-308. (Volume 20, No. 
3. March .1998). In 4he .preferred embodiment of the 
... invention. a,bottom up strategy is employed, utilizing the 
data element at the click point as the beginning of the 
.^segmentation extension analysis. However, segmenta- 
. tion is not performed on the entire scanned document 
as is .typically -done, but Is halted after the boundary for 
the.regjpn of Interest surrounding the click point has 
.v.been. determined. The region of interest contains a set 
of data .elements from the variable resolution preview 
scan, and the boundary is determined by the set of con- 
nected outermost data elements. 
[003.5] If the region of interest is rectangular In nature, 
extension js performed along a linear front, resulting In 

- a selection marker that is a rectangular bounding box. 
. For non-rectangular "lasso" regions of- interest, exten- 
sion is performed, along a non-linear front, resulting in a 
selection ^marker that, is a "lasso" around the region of 

. interest. ■ ■ 

[0036] After performing segmentation analysis. In step 
402 scanner software 124 perfornns classification analy- 
sis on the set. of data elements contained within the 

- boundary ^established by step 400. Various techniques, 
jalso welL known in the art.for performing classification 
analysis, are also disclosed in the two articles cited 
above.- In the preferred embodiment of the Invention, the 
clas.sifieatipn method used is ,.that^ disclosed in Patent 
NO. 5,596.655-lssued to Patricia D. Lopez on January 

- 2-1,- 1997'., Upon^corripletlon of classification analysis. 
Fl<3. 4 then returns- ta FIG. 3A. . , . . .. . 
[0037] Fl|5..5 shovys a block diagram for updating the 
computer monitor display, based on the selected area 
and its d^.ta type. Referring. now tcFIG. 5, -in step 500 a 

' selection marker is displayed In variable resolution pre- 
view/ scan,204.(FLG. 2) in monitor 1.10 (FIG. 1) around 
• the region of .interest determined from either FIG. 4 or 
. from^FIG. 7. vyhich-ls discussed below. If a selection 
.marker js already 'displayed, when FIG. 5 Is called, that 
selection marker i^ removed from display before dis- 
. playing:, the next selection .marker. In step 502 the 
j-emainder of variable .resolution preview scan 204 lying 
^outside pf the region of Interest bounded by the cur- 
^.rently displayed, selection marker is grayed out. 
([0038] Step 504^. determines the , data .type of the 
region of Interest. -If the data type„ln the region of inter- 
est is text, or -.bJack and white line. art. then control 
: passes to . step 506 where, scanrier softvyare 124 
updates the output in black and white threshold window 
242 (FIG. 2). In step 508 scanner software 124 updates 
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the resolution, scaling, output dimensions, and file size 
within status bar 222 {FIG. 2). In step 510 the'corvtrols in 
black and white threshold window 242 (FIG. 2) are ena- . " 
bled for user input. The user may make manual changes ' 
using the controls that have been enabled prior to initi- - 5. .- 
ating a re-scan of the selected region of interest. In step • 
512 the controls for exposure adjustment window 238 
(FIG. 2) and color adjustment window 240 (FIG. 2) are 
disabled from user input, and are grayed out. Thus, the . 
steps in steps 506. 508. 510. and 512 automatically w 
make many of the adjustments.that the user would nor- . 
mally have to make manually in other prior art scanning 
systems after selecting an image for scanning. The cur- ^. • 
rent invention reduces the complexity of the software 
and confusion of controls that the typical user nnay not 15 
understand. At this time, the user may also make man- 
ual changes using the controls that have been enabled - 
prior to re-scanning the selected image. -1- 
[0039] In step 504. if the data type in the region of " ■ 
interest is gray scale photographic, then control passes 201 
to step 514 where scanner software 124 changes the 
output in exposure adjustment window 238. In step 516 ^- 
scanner software 124 updates the' resolution, scaling. = 
output dimensions, and file size within status bar 222. In 
step 518 the controls in exposure adjustment window 25^ 
238 are enabled for user input. The user may make 
manual changes using the controls that have been ena- 
bled prior to initiating a re-scan of the selected region of 
interest. In step 520 the controls in color adjustment v- 
window 240 and black and white threshold window 242 - 30 
are disabled from user input and are grayed out. " - 

[0040] In step 504. if the data type in the region of - 
interest is color photographic, then in step 522 scanner 
software 124 changes the output in exposure adjust- * 
ment window 238 'and in color adjustment window 240. -35 
In step 524 scanner software 124 Updates the resblu- ^ '" 
tion. scaling, output dimensions, and file size within sta- 
tus" bar 222; In' step 526 -the controls - in exposure - 
adjustment window 238 and color adjustment window 
240 are enabled for user input'/ The user may make 
manual changes using the contrbfs that have been ena- 
bled prior to initiating a^ re-scan of the selected region of 
interest.' In step 528 the controls in' black and white 
threshold window 242 are disabled from user input and 
is grayed out. After any of steps 512. 520. or 528. FIG. 
5 returns to fig: 3. ^ '-^ 

[0041] Thus, the steps in steps- 506. 508. 510. and -f^ 
^512: steps 514. 516; 5113. a'nd 520; and steps 522. 524. - 
526. and 528, automatically niake many of the adjust- ■ '* 
nrienis that the user would normatiy have to make man-' so 
ually in other prior art scanning' systems after selecting 
a region bf ihterest"for scanning. The' current invention - 
reduces the' complexity bf the software user interface'^ - 
and confusion of controls lhat the typical user nnay not- * - 
und^r stand. " ' . ' ^ 

[0042] FIG. 6 shows a block diagram for perfornning an 
optimized final scan of the selected region utilizing the 
drag and drop feature from the Win&ows 'operating sys- 
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tem. Referring now to FIG. 6. in step 600. a data object 
:is created and a list of one or more predetermined data 
formats provided in scanner software 1_24js loaded into 
^memory, based- on the-"rnQuse down" . input -signal 
selectirtgthe region of interest displayed in monitor 110 
(FIG. 1) whose data. type.-or (;Jassification, Jwas:deter- 
,. mined In RIG. 4. ' - ^ ; . t. 
[0043] Step 602 **determines if a V mouse over' input 
signal from graphical input device 108. which is handled 
by operating system 120 (FIG. 1) from a call made by 
scanner software: 124. 'Js received identifying an open 
application in monitor IIQ.^or identifying scanner soft- 

■ ware window 200 .itself. If the. "mouse, over^ input signal 
is received identifying scanner software window 200. 
control passes to step 610. Step,610 th^n determines if 
a "mouse drop" input signal is received from graphical 

"fnput- device:- .108 selecting scanner software window 
. '200 displayed in monitor 110. This indicates 4hat the 

■ userdecidednot to initiate an optimized final scan. If the 
r answer is yes, then FIG. 6 returns to FIG., 3. If the 

answer in step 610 is no, indicating no "mouse drop" 
signal was received, or that^pointer 214: left scanner 
software window 200, then control returns to step 602. 
[0044] If the "mouse over" input-signal in step 602 is 
received identifying an .open application, which was 
opened by a call to the application software, such as 
first software application- 126 (FIG. 1). then operating 

- system 120 notifies first software application 126 that 
pointer 214 has^entered its window. Then in step 604 
first software application 1 26 queries the list of predeter- 
mined data formats associatedrwith the data object cre- 
ated in step 600. If one or more acceptable formats are 

: found-In the list generated in . step. 600. then first soft- 

- ware application^ 1 26 lets operating system- 120 know 
^ that it can receive the data and indicates a preferred for- 

mat from the one or more acceptable formats; Step 612 
then determines if a "mouse drop" input signal from 
-graphical:- rnput device 108 is received, selecting first 
software-application 126. If the answer is no. indicating 
no. -mouse drop" signal was received, or that-.pointer 
'2T4 has-left the^first software application 126 window, 
then-controi returns- to step 602. If the answer -in step 
' 6-12=iS'yes, indicating that -a "mouse, drop" input signal 
WaVreceived. then*in step'614 first software application 
•126'makes a call to operating system 120 and requests 
the image' data -in. the format tt'prefers. -Then, in step 
' €^T6,is6anner software 1-24 sends a command to scan- 

• - ner4i4' (FIG. .1 ). launching an optimized final scan of the 

■ '"document, and the image*data from the optimized final 

• 'sc^ari 4s~put Into the format requested. The image data 
butput^^from^ the optimized final scan for the region of 
interest portion of the document is sent to. first software 

•^Application- 126." where the image data resides in the 
'"•'''Selected data format for further manipulation by the user 
' within '-first software application; :1 26. Control then 
returns to FIG. 3. . ■* " ;:: 

[0045] If in step 604 first software application 126 can- 
not find a format for the data that it can accept from the 
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•list g^neraifed in step 600. then step 608. changes the : Clainns. . . ; v 

tlisplaVed pointer'214 to the univereal""no*^icon..a cird^ .... • - 

'wfth a diagonal slash through It. indicating4hat-a drop of • a user interface nnethod, within a connputer system 

the data object' will hot be allowed. Step '610 theadeter- .(100), for- selecting and classifying a region of a 

mines if' a- "nnouse drop'*-* input signal is received fronn s' scanned docunrient comprlsing:- 
graphical input device 108 on first so'ftvvare application . • . 

126. Ifihe answer is yes.f then ;FlG.-6 returns. to FIG. 3. .(a) sending a signal to a scanner device (114) 

If the answer" in step:610 is no, then- control ^returns to . .. * \ to scan (300) a document previously placed on 
step 602. ^- v. ' V . .: . - i ... said scanner device (114). wherein said scan- 

[0046] FIG. /-shows a block diagram for re-sizing the io * ner device:(1 14) is.directed to scan said docu- 
bo'uhdary of a selected area. Refen-ing now taflG. 7, : ( ' - ment using a prevjewscan mode to produce 
step 700 (determines if the click input with graphical - — ■ preview scan data of said document; 
input 'device- 108. simultaneous with a-control key held - - (b) displaying (302) said preview scan data of 

' down, Was received within, or outside of. selection , said document in a preview box (202) within a 

marker 216 (FIG. 2). If the click input was..within.selec- '^5 - scanner software window (200) of a monitor 

tion marker 2t6; indicatingthat the user wants a smaller ^ " (-110) attached to said computer system (100); 

"area thai=i what was Automatically generated in FIG. 4. (c) receiving (306) a first click input from a 

then step 704 finds a subset of the data elements within • . • • ^ graphical .input device (1Q8) attached to said 
selection marker 216 immediately surrounding the click ^ . , computer system (100), wherein said click 

point, and establishes a new, snnaller boundary around 20 ■ input identifies a point on said monitor (110), 
the subset- of data-elements. Then, in step 706. scanner , said point being located within a first region of 

software 124 performs^ classification-- analysis on the . . , interest within said preview scan data within 

subset of data elements ^contained within-, the new • : said preview box (202) within said scanner soft- 

boundary "established by step 704. RG. 7. then returns , . , - ware window (200) of said monitor (1.10); 

to FIG. 3. • : ^ ' - . ,35 ^ . (d). segmenting (400) sai_d. preview scan data 

[0047] If in step 700 the click input with .graphical input : .within .said first region of interest to locate a first 

device 108. simultaneous with a control key hejd down, . boundary of said first region of interest; and 

was received outside of selection marker 216, indicating r (e) displaying, (500) a first .selection marker 

that the user wants a larger area than-^what was auto- . around said first boundary of said first region of 

matically generated in -FIG. 4, control passes to step 30 ..interest within said preview box^(2q2) within 

- 702. Step 702 determines if the click input with graphi- ■.. - said sqanaer .software window (200) of said 

cal input device lOB, simultaneous with a. control key . - ; ..c monitor (110). . /.r^,. 

held' down, was 'on white space or non-white; space. If - - - - , . . ... 

the click input was on white space, then step 712 j;- . 2.; A. u^er interface. method, within a comput^er system 
expands" -the boundary to encompass- the. entire -.^5,, . (lOOJ^.- for selecting and classifying a region of a 
scanned document. FIG. 7 then returns to FIG. 3. > : - scanned, docupnent. acqordipg .to claim 1 wherein 
[0048] If the click input in.step 702 was .on nc^n-white ^ . , ^ step, (b) further connprises steps (b1) through (b4): 
space. Uhen step 708 makes an adjust mwt? to the .,.. - , , . , ^ . . 

-parameters^^used in ^ the segmentation;^ artalysis. Thenev.- - \ . .-^bt) displaying a.status bar (222) in said pre- 
step 7T0 calls FIG.-4 to evaluate the data:etem^nts sur- - . 40 - : ...^ view- box (202), in .said scanner software win- 
rounding ^he click: f^int with the new parameters to ^ . . . ^dowf....(2Q0)... wherein said preview box (202) 
determine- a ^superset of data : elemQatse aHctia new y,, - . i . contains, ^aid p^r^yiew^scan data, and further 
boundary, and to determine the data .type :Of t^.^' super- • - . ^ wl^rein sai^^^t^t^s bar (222) further comprises 

set of data elements within the new bQtmd^ry After _ - a classillcation display, a resolution display, a 

returning from FIG;:4. F:IG^ 7 then returns. to FIQ, 3. 45 scaling display, an output dimension display. 

[0049] Having d-escribed-.a .presently preferr^d^embod-: ^ : . and- a/ijf . size display; 

'iment of the-:presentinvention.-itwill.:b'e> understood by : _ : , (b2). displaying .an- exposure adjustment win- 
those skilled in the ^rt thatimanyichiang^s. in. construe-. : , dow (238), in said scanner' ^oftware window 

tion and^circuitrv and widely differing e^:!bJ^d^me^ts^d. , ...c- • i2pp) gdjaceptVs^id preview box (202); 
■ applications 'Of the invention-wiil .suggest themselves- -50,^.. , (b3).. .displaying > , .color adjustment window 

. . .„p (2450)/in.'said. scanner software window (200) 
r-fi: ii^^^c^nt lo.,said preview box (202); and 

^ . (b4) di^spiaying a black.and vyhite threshold win- 
dow (242) in said scanner software window 
55^ (200) adjacent to said preview box (202). 

- \ 3.. . A user interface method, within a computer system 
(100). for selecting and classifying a region of a 



without departing from therscdpe- of the pr«se^fit inven- 
tron. as defined tin the claims. Th^ disQ|osur^.?t^nd the. 
' description herein are intehded^tobe Hlustra^ve^and are* 
not in any- sense limiting of the- invention. -defined- in 
scope by the following claims. ; ' ; • : - i. 
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scanned document according to claim 2 wherein 
step (d)'further comprises steps (d1) and (d2): 



(d1) locating said first boundary of said first 
region of interest by performing (400) segmen- - ■ 
tation analysis on a plurality of data elements 
within said preview scan data, .wherein said 
plurality of data elements surround a first data 
element derived from said first click input on 
said region of interest in said preview scan data * re- 
displayed in said preview box (202) within said 
scanner software window (200) of said monitor 
(110). and further wherein said segmentation 
analysis determines a set of data elements 
derived from said plurality of data elements that " 15 - 
comprise said first region of interest, wherein 
said first boundary comprises- a set of outer- 
most data elements of said set of data ele- 
ments, and 

(d2) performing (402) classification analysis on 20 ■ 
said set of data elements of said first region of . . - ^ 
interest. 

A user interface method, within a computer system 
(100). for selecting and classifying a region of a 25 
scanned document according to claim 3 further 
comprising: • ' - 

(f) reducing said first boundary of said first - . 
region of interest, bounded by said first selec- 30 
tion marker, by receiving (700) key down input 
from a predetermined control key from a key- 
board (106) simultaneous with receiving a sec- 
ond click input from said graphical input device 
(108) on said first region of interest within said 35^ 
first selection marker in said preview box (202); • " * 



5. A user interface method, within a computer system 
. (-100). for selecting and classifying a, region of a 
scanned document according to claim 3 further 
comprising: 

(f) expanding said first region of Interest, 
bounded- by said -first -selection marker, by 
receiving (702) key down input from a predeter- 
mined controLkey from a keyboard (106) simul- 
taneous with receiving a second click input with 
said graphical input device (108) on an adja- 
cent region of interest in said preview scan 

'data, wherein said adjacent region of interest 
lies outside of said first region of interest 
bounded by said first selection marker in said 

: preview box (202) within said scanner software 
: window (200); 

(f1) adjusting (708) at least one segmenta- 
tion parameter of said segmentation analy- 
sis; • ' . . • 
{f2) finding a super set of data elements by 

' ' ' performing (400) said segmentation analy- 
sis with said at least one adjusted segmen- 
tation parameter on a plurality of data 
elements surrounding a second data ele- 
ment derived from said second click input 
on said adjacent region of interest in said 
preview scan data displayed in said pre- 
view box (202) within said scanner soft- 
- ware window (200.) of said monitor (1 10): 

(f3) determining a second boundary of said 
super set of data elements, wherein said 
second boundary comprises a set of outer- 

•~ most -data elements of said super set of 

I . . data elements; 



(f1) finding (704) a subset of data elements (g) removing (500) from display In said preview 

from said set of data elements of said first • ' ' box (202) said first selection marker; and 

region of interest, wherein said subset of 40. ^■r :. - (h) .displaying (500):'in said preview box (202) 
data elements surrounds a second data -="v , ::within^ said scanner software window (200) of 
element derived from said second click. . * : - said monitor (1 10), a second selection marker 
input on said region of interest in said pre- . -^c-- around said second boundary from step (f3). 

view scan data displayed in said preview 

box (202) within said scanner software ' 45- ^ Sr- :Auser interfaceVmethod, within a computer system 
window (200) of said monitor (1 10); • ' ^---^"^ flOO). for;setecting-and classifying a region of * a 
(f2) determining a second boundary of said " icanned document according to claim 3 wherein 

subset of data elements, wherein said sec- ' • ■^^-step (d1) further comprises step (d1 a): 
ond boundary comprises a set of outer- - ^ ' ' ---^ - * - ' 

most data elements of said subset of data so (d1a) perfprming.(400) said segmentation anal- 

elements; - • ' - Ysis linearly, wherein said first selection marker 

/ n placed around said first boundary of said first 

(g) removing (500) from display in said preview ' h . .. region of interest :in said preview box (202) 
box (202) said first selection marker; and v i.Twithin said scanner software window (200) is a 

(h) displaying (500), in said preview box (202) 55 ^t '- rectangular bounding box.* 
within said scanner software window (200) of - ' : r 1. v' ' 

said monitor (110). a second selection marker ^ » 7. A user interface method, within a computer system 
around said second boundary from step (f2). (100). for selecting and classifying a region of a 
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;':'scahn*ed document according to claim 3 wherein 
'step (d1) furiher'comprises step (dia): - 

(dia) performing (400) said segmentation anal- * 
.-'Cy^i^ hon-linearJy,:. wherein, said first selection 5 
■-s- marker pla'ced ^around said first boundary of'- 

- ' ''said first region- of. interest in said preview box • ' 
: : I . ' (202) within' said scanner' software window 

-"^■^ ^200) is ;ja V non-rectangular., lasso selection 

'nnarker.- • - • - .10 

■*8: A user interface method, within a computer system 

(lOO).-for selecting and classifying a region of a - 
scanned document according to claim 3 wherein . 
step (d2)' further comprises step (d2a) and step (e) • 75 
further connprises steps (el) through (e4): 

■ - ■ * * (d2a) deterrhinrng (504) from said classification 
analysis that said first region of Interest is a text 
region (206) or a black and.white line art region .20 
r (208); ' - : - 

.•■:('e1) updating (506) said black and white 
:. ■ threshold- window (242) with output pertaining 
- to said first region of interest; 
(e2) updating (508) said classification display, ■:25, 
said resolution display, said scaling display, 
said output dimension display, and said file size 
display, within said status bar (222). with output 
- pertaining to said first region of interest; 
^'(e3) enabling (51 0)^ a plurality of black and 30 
white threshold window (242) controls for user 
input; and ' 

. (e4)" disabling (512) a plurality of exposure - 
. > r adjustment window. (238) controls and a plural- . 
Ity of color adjustment window (240) controls 35 
from user input. 

9. A user interface methodvwithin a computer system : : 
(100). for selecting and classifying a region of., a 
scanned .document according tot claim 3 wherein ^ .40 
step (d2) further comprises- step. (d2a) and step (e) • k 

- further comprises steps (el) through (e4); • 

(d2a) determining (504) from say classification - ^ 
. analysis that said first region of interest is a 45 

" gray scale. photographic region (212); 

(el). updating, (514) said exposyre^adjustment . 

window (238) with output pertaining to said first ... 

region of interest;- - - ^ : 

(e2)- updating (316) . said classification display, so 
. : said resolution - display. sa.id . scaling display, 

said output dimen.sien display and said file size • , x^. 

display, within said. status bar'(222), with output 

pertainlng-to said first region pfiinterest; „ : 

(e3) enabling (518) a plurality of exposure 55 
: adjustment wmdow - (23.8)- controls for user 

' \' input;- and ^ : - ■ \. 

(e4) disabling (520) a plurality of color adjust- 



: ; ment window (240) controls .and a plurality of 

black and white threshold window (242) con- 
trols |rom user input. 

10, A user interface method, within a computer system 
(100), for selecting and classifying a region of a 
scanned document according to claim 3 wherein 
step (d2) further comprises step (d2a) and step (e) 
further comprises steps (el) through (e4): 

" ^ . (d2a) determining (504) from said classification 
/ analysis that said first region of interest is a 
color photographic region (.210); 
(el) updating- (522) said exposure adjustment 
. ■ . window (238) and said color adjustment win- 
dow (240) with output pertaining to said first 
' region of interest;. 
(e2) updating (524) said classification display, 
said ..resolution display, said scaling display, 
said output dimension display, and said file size 
display within said status bar (222). with output 
pertaining to said first region of interest; 
■ ^ (e3) enabling (526) , a plurality of exposure 
..- . adjustment window (238) controls and a plurat- 
: ity of color adjustment window (240) controls 
for user input; and , . 

(e4) disabling (528) a plurality of black and 
white threshold window (242) controls from 
user input.. . . . 
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